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^ Helton, Lasserre, and Putinar (2008, Ann. Probability; arXiv:math/0702314) expose 

OO the relationship between three properties of a measure: the conditional triangularity 

property of the associated orthogonal polynomials, the zeros in the inverse condition 
of the truncated moment matrix, and conditional independence. The purpose of this 
article is to provide examples of parameter collapse to product structure given that 
r~| the zeros in the inverse condition holds up to some degree d. Specifically, start with 

a parameterized family of probability density functions; require that the zeros in the 
^ inverse condition up to degree d holds; and validate that imposing this restriction 

I— I on the parameterized family results in a measure with product structure, or at least 

I that conditional independence holds. Algorithms related to parameter collapse are 

I> supplied, including the computation of the zeros in the inverse condition up to 

degree d. 
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1 Introduction 



Generalization of independence certificates for multivariate probability distri- 
butions is exciting. For instance, techniques such as those found in [2] could 
be generalized to non-normal variables. As a specific example, near the vari- 
able bounds of instrument operation error distributions are known to be non- 
Gaussian. In short, if a data set is fitted by a particular family of multivariate 
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distributions, the algorithms supphed in this article provide a statistician with 
the knowledge of precisely how many moments must be calculated to ensure 
variables are independent, or at least conditionally independent. 

This is perhaps the most interesting aspect, that parameter collapse to product 
structure can require computation of moment matrices of order greater than 
2. To exhibit independence of variables for multivariate Gaussian distributions 
one much check the truncated moments only up to order 2, but proving inde- 
pendence of variables for some distributions requires higher moments. When 
a parameterized family of distributions exhibits parameter collapse, the min- 
imum order of the zeros in the inverse condition required for the measure to 
exhibit product structure is called the parameter collapse order of the param- 
eterized measure [1, §6 Definition 3]. 

Finally, the computations of moments of polynomials by hand is tedious, at 
best. Maple routines are provided in the appendix to automate computations. 
Furthermore, a program is available upon request that computes the parameter 
collapse order of a particular family of multivariate measures. Assistance for 
translation to other computer algebra systems or languages is offered and 
code is immediately available in Maple, Mathematica, Matlab, C, and Java. 
In particular, it may prove beneficial to integrate these routines with existing, 
high-powered software [3]. 

The following examples are meant to provide elementary exposition of the 
analysis discussed above. 



2 Examples 



2.1 Preliminary example 



Consider the following parameterized multivariate distribution with product 
structure. Let Xi,X2,X3 be independent Poisson processes on M.^ = (0, oo) 
with probability density 



\k k-l -\x r\ OO 



- ■,r{k)= ft'-'e-'dt. 

X < 



Let \t = X and for simplicity, A = 1, so that the joint distribution is 



T{ki) T{k2) r(/c3) 
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a measure with product structure. To compute moments, we are led to the 
gamma function 



„ Xl e X2 
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For Xl and X2, Mi and Mf ^ are: 
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From m Theorem 5], the zeros in the inverse property is equivalent to the 
orthogonal polynomials satisfying the conditional triangularity. For Xi and 
X2, M2 and M2^ are: 
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Compare M2 ^ with Figure 2.1 
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Fig. 1. Zeros In the Inverse Condition for d=2 and d=14, respectively. The blue 
dots indicate non-zero entries. 



2.2 First example of parameter collapse to product structure 



Let £ be a nonnegative integer. Given the bivariate distribution defined on the 
positive quadrant: 



(^,2/) = ^e-(^+^)(x + yr, (1) 



where C(£) = E5=o^K^ - J + W + !)• 

Calculate Mf ^ and set the (3, 2) which is the (2, 3) entry to zero. Skipping 
messy details, this reduces to: 



= v{i) =ij J Pii^i y)dxdy ] ij J xypi{x, y)dxdy 
\o / Vo 

oo oo ^ 2 

xpi{x, y)dxdy 



\0 



It can be shown that v{£) < for i > 1. Therefore, £ = is the only solution 
which satisfies the zeros in the inverse property for the first truncated moment 
matrix, and po{x,y) = e~^e~^ has the product structure indicating indepen- 
dence. The parameter collapse order of p^{x,y) is 1. Remark that there are 
a number of similar, parameterized, bivariate, exponential distributions that 
exhibit parameter collapse. 
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2.3 A bivariate exponential non-example 



A multivariate Gamma distribution studied in [4, Chpt 41§3] is: 



0-10-2(1 - p) 
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where Jq is the modified Bessel function of first order (with v = 2). 

Solve the collapsing of parameters problems via the Maple code provided in 
the appendix and the following lines: 



> assume (signial>0) ; assume (sigma2>0) ; assume(rho <1) ; 

> additionally (rho >0) ; 

> f:= (x,y) -> (l/(sigmal*sigma2*(l-rho)))* 

exp (- (1/ (1-rho) ) * (x/sigmal+y/sigma2) ) * 

BesselJ (2 , 2*sqrt (rho*x*y/sigmal/sigma2) / (1-rho) ) ; 

> equations := zeroslnlnverse (f , 1) ; 



A zero in the (3,2) entry of the first truncated moment matrix implies 



The left hand side is zero only if p = 0, but then ^0-1,0-2,0(2;, y) = is not a pdf. 
Thus, J9oi,o-2,p(2^5 never has product structure. 

2.4 An example with compact support 

Consider a probability density function found in [5i §15.4], 



where R G SL{2,'R and {x,y) G -8(0,1) C M^. Ignore the normalizing con- 
stant, with ad — be = 1, 



(1 - (p2 + 2p (1 - ln(l + p)) - 2 ln(l + p)) = 0. 




pdfnix, y) = 1 -\ — (ax^ + cxy + bxy + dy'^ 



V 
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The first order zeros in the inverse condition reduces to c + 6 = 0, implying: 

pdfnix, y) = 1 + ^ (ax^ + dy^^ . 

The second order zeros in its inverse condition is: 
= 3a^ + 36a + 22da + 48 + + 36d. 



Prom which four cases arise, all of which do not allow for solutions when the 
third order zeros in the inverse condition is imposed. Therefore, parameter 
collapse does not occur until degree three. 



2. 5 Polynomial and discrete pdfs 

The previous section provided an example of parameter collapse requiring 
degree greater than 2. The computations were easier, as the only product 
structures allowed were trivial ones. Consider measures on [0, 1] x [0, 1] of the 
form 

deg k 

In this case, positivity is required on [0, 1] x [0, 1]. By integrating, we see: 
For simplicity, ignore the above normalization constraint which would yield: 

1 1 deg k deg k 



deg k 



Consider the measure: 

^^yao.o,ai.o,ao,i,ai,i(a.^^) = tti^iXy + ttiflX + ao,l2/ + ao,o 

The first order zeros in the inverse condition requires anOoo = Oioctoi; which 
then would imply: 

On 
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which is of product form. Parameter collapse occurs in the first order. Pa- 
rameter collapse for the most general polynomial and discrete measures of 
higher order result in only conditional independence. One interesting question 
is, which parameterized higher order polynomials exhibit parameter collapse 
to full independence? Note that the answer may yield irreducibility criterion. 



3 Conclusion 

There are a wealth of examples of parameter collapse due to the zeros in the 
inverse condition. One task related to other areas of research is automation of 
product form recognition for functions. Another unanswered question related 
to [6j is, "Which polynomials may represent pdfs?" An interesting problem 
whose solution requires analysis of integral equations is, "For integer n, what 
is the general form of pdfs that exhibit parameter collapse order n?" The latter 
two questions depend heavily upon the domain of the pdf. 



A Maple Code 

Here is a maple procedure that calculates the truncated moment matrix of 
order d for the bivariate pdf, g{x,y); computes the inverse; and creates a list 
of equations generated from the zeros in the inverse condition. 



> restart: with(linalg) : 

> zeroslnlnverse := proc(g: : operator, d: : integer) 
> 

> # set up the structure of the truncated moment matrix 

> L: = [] : 

> for i from to d do 

> for j from to i do 

> L:=[op(L) , [i-j , j]] : 

> end do; 

> end do; 
> 

> #fill truncated moment matrix using appropriate domain for g(x,y) 

> B := (i,j) -> int (int (x"i*y"j*g(x,y) ,x=0 .. infinity ,y=0 .. infinity) ; 

> A:=matrix(nops(L) ,nops(L)) : 

> for i from 1 to nops(L) do 

> for j from 1 to nops(L) do 

> A[i,j] := B(L[i] [1]+L[j] [1] ,L[i] [2]+L[j] [2]); 
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> end do; 

> end do; 

> C : = inverse (A) ; 
> 

> #Generate set of equations from zeros in inverse condition 

> S:=0; 

> for i from 1 to nops(L) do 

> for j from i to nops(L) do 

> if (max(L[i] [1] ,L[j] [l])+max(L[i] [2] ,L[j] [2]) > d) 

> then S:={op(S) ,C[i, j]=0}; end if; 

> end do; 

> end do; 

> S 

> end proc : 



Thus, for a particular pdf, as in example [Tj 



> assume (ell : :nonnegint) ; 

> p:= (x,y) -> exp(-(x+y))*(x+y)"ell/(ell+l) ! ; 

> equations = zerosInInverse(p, 1) ; 



The next step would be to run the following command. 



> solve (equations) ; 
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